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Assessing  and  Controlling  the  Availability 
of  Failure-Degraded  Service  Agents 

by 

D.  P.  Gaver  and  P.  A.  Jacobs 

EXECUTIVE  SUMMARY 

Military  items  such  as  airborne  surveillance  systems  (UAVs,  JSTARS,  helicopters, 
etc.)  or  combat  vehicles  (tanks,  APCs,  ships)  may  have  high  effectiveness  when  available 
on  station,  but  require  occasional  restoration  (refueling,  re-arming,  scheduled 
maintenance)  and  repair  after  unscheduled  failures  of  certain  subsystems.  This 
requirement  takes  them  off  station,  where  delays  occur  that  are  affected  by  the  numbers 
and  types  of  support  resources  and  the  philosophy  of  scheduling  those  resources. 

This  paper  considers  the  effect  of  decision  choices  on  long-run  item  availability  on 
station  when  items  can  be  in  several  levels  of  capability/effectiveness  when  on  station. 
The  model  is  used  to  show  that  a  simple  binary  decision  rule  (that  depends  on  ratios  of 
endurance,  failure,  and  restoration  and  repair  rates)  guides  the  decision  as  to  whether  a 
failed  item  should  be  completely  repaired  to  its  highest  level,  or  returned  to  duty  at  an 
incompletely-capable  state. 

View  this  as  an  indicator  of  the  types  of  rules  anticipated  to  apply  in  realistic 
generality.  These  will  be  the  subject  of  additional  research. 
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1.   Introduction  and  Problem  Formulation 

In  a  variety  of  situations  several  individual  items  (agents)  coexist  and  perform 
operational  functions,  such  as  region  surveillance  or  actual  combat.  They  require 
occasional  support  (e.g.  if  vehicles,  or  military  "platforms",  refueling  and  repair).  Time 
out  for  restoration  (refueling)  is  inevitable  and  unavoidable,  but  failure  of  a  unit's 
functional  capability  or  operational  condition,  while  necessary,  need  not  be  complete:  a 
partially-failed  or  degraded  unit  can  profitably  remain  active  under  some  circumstances. 
Under  certain  circumstances,  to  be  described,  it  is  overall-effective  to  partially  repair  a 
completely  failed  item  rather  than  expend  time  and  resources  for  repair  to  complete 
functionality.  A  unique  military  situation  is  that  in  which  an  item  has  been  subjected  to 
chemical  or  biological  attack,  and  must  be  decontaminated:  there  can  be  a  choice  between 
partial,  or  complete  decontamination;  see  Klutke  and  Novikov  (1996).  In  this  paper  we 
provide  initial  models  and  rules  for  the  control  of  all  such  systems. 

Examples  of  the  options  and  decision  choices  occur  extensively  in  the  military: 
depending  on  need  for  information,  it  may  well  be  more  effective  to  quickly  field 
partially  effective  sensor  (e.g.  UAV)  systems  than  to  wait  for  complete  repair.  The  same 
can  be  true  of  tactically  required  artillery  pieces,  tanks,  or  reconnaissance  or  attack 
aircraft;  the  choice  of  partial  or  total  decontamination  is  another  example,  mentioned 
above.  Other  examples  occur  when  prompt  assistance  is  needed  after  an  emergency, 


either  natural  (e.g.  earthquake  or  fire)  or  terrorist-caused.  Failures  may  now  be  injuries  to 
humans  or  infrastructure;  partial  "repair"  means  initial  diagnosis  and  stabilization  of  an 
injured  individual,  or  provision  of  temporary  alternative  communication  or  transportation 
service. 

The  situation  modeled  is  analogous  to  the  classical  repairman  problem  (see  Feller 
(1968))  but  is  more  general  -  and  realistic  -  in  that,  for  us,  the  classical  "machines",  our 
agents,  can  fail  partially,  i.e.  to  one  of  several  intermediate  levels  of  productivity  and 
then,  having  finally  reached  the  restoration-repair  service  facility,  can  be  repaired  there  to 
chosen  levels.  This  control  feature  is,  in  principle,  accomplished  probabilistically  in  our 
models.  The  control  objective  is  to  maximize  the  expected  utility  of  the  system  of  agents, 
using  as  control  options  the  rate  of  demand  for  repair,  and  the  choice  of  repair  objective. 
The  utility  function  involved  is  a  linear  function  of  the  numbers  of  agents  available  in 
each  performance  category.  For  UAVs  this  can  be  expected  time  on  station,  weighted  for 
sensor  capability. 

Our  analysis  begins  by  proposing  a  quasi-stochastic  "expected  value"  or  detenrdnistic 
model  for  a  system  of  agents  that  can  each  be  in  one  of  three  states  of  performance 
capability:  Good,  Medium,  and  Bad.  When  restoration  or  repair  is  required  the  agent 
progresses  to  a  central  homebase  server  at  which  accumulated  and  queued  restoration  and 
repair  tasks  are  processed  in  a  weighted  processor-sharing  manner  (this  is  unrealistic  in 
detail,  but  is  analytically  tractable;  it  will  be  useful  for  guiding  more  detailed 
simulations).  Control  is  accomplished  by  choice  of  the  weighting  probabilities.  This 
model  accounts  for  restoration-repair  facility  saturability  by  using  an  approximation 
described  in  Filipiak  (1988).  The  deterministic  model  is  especially  convenient  for 
exploring  time-dependent  or  transient  system  behavior. 

Next,  a  Markov  stochastic  network  version  of  the  above  model  is  constructed  using 
the  techniques  of  Kelly  (1979).  The  implications  of  the  two  model  types  are  compared 
numerically  and  seen  to  be  in  useful  agreement  for  the  utility  function  adopted. 


Our  work  is  related  to  policies  for  minimal  repair;  cf.  Brown  and  Proschan  (1983), 
Phelps  (1983),  Chen  and  Feldman  (1997),  Kijima,  Morimura,  and  Suzuki  (1988)  and 
Righter  (1997).  Also  relevant  are  analytical  models  of  sortie  generation,  Hackman  and 
Dietz  (1997)  that  address  more  complex  setups  in  a  steady-state  context. 

2.   A  Pseudo-Stochastic  Deterministic  Expected-Value  Model 

The  system  will  be  described  in  terms  of  the  following  state  variables.  For  the  present 
model  these  are  real-valued  and  positive  functions  of  time;  in  the  subsequent  stochastic 
model  they  are  state  variables  of  a  multivariate  Markov  process  in  continuous  time. 

Let 

Uc(t)     =  number  of  agents  in  Good  condition  and  Up  (productively  available)  at  time  r; 

£/m(0     =  number  of  agents  having  experienced  a  degrading  failure  and  Up  at  time  f, 
such  agents  are  said  to  be  in  Medium  condition; 

DGB(t)    =  number  of  agents  that  have  experienced  a  mission-affecting  failure  (MAP) 

while  in  Good  condition  and  that  are  Down  for  repair  at  time  t,  such  an  agent 
is  totally  unproductive  and  is  said  to  be  in  Bad  condition;  it  will  be  repaired  to 
the  Good  state; 

Dmb(0    =  number  of  agents  that  are  Down  at  time  t  because  of  a  mission  affecting 
failure  from  the  Up  Medium  state; 

a  decision  opportunity:  a  fraction  g^g  are  sent  for  further  repair  to  Good, 
1  -  O-mg  are  released  to  Up  Medium  state; 

DGR{t)    =  number  of  agents  in  Good  condition  that  are  Down  for  restoration  (refueling 
etc.);  they  will  be  restored  to  the  Good  state; 

Df4R(t)    =  number  of  agents  in  Medium  condition  that  are  Down  for  restoration  to  the 
Medium  state  at  time  f; 

a  decision  opportunity:  a  fraction  am  are  sent  for  further  repair  to  Good, 
1  -  ccmr  are  released  to  Up  Medium  state; 

DMG(t)   =  number  of  agents  Down  in  Medium  condition  after  minimal  repair,  waiting  for 
repair  to  the  Good  state  at  time  t. 


Parameters: 

N  =  Total  number  of  agents  (e.g.  mobile  sensors) 

Xgm         =  rate  of  occurrence  of  a  degrading  failure  for  a  Good  Up  system 

Xgb         =  rate  of  occurrence  of  a  total  failure  for  an  agent  (e.g.  a  sensor)  in  Good 
condition 

Xmb  =  rate  of  occurrence  of  a  total  failure  for  an  agent  in  Medium  Up  condition 

\/eg  =  mean  endurance  time  for  an  agent  in  Good  condition 

1/sm  =  mean  endurance  time  for  an  agent  in  Medium  Up  condition 

l//ir(G)  =  mean  restoration  time  for  an  agent  in  Good  Down  condition 

\ll±r(M)  =  minimal  mean  restoration  time  of  an  agent  in  Medium  Down  condition;  agent 
will  remain  in  Medium  condition 

l/jdm(B)  =  minimal  mean  time  to  repair  an  agent  that  has  experienced  a  fatal  failure;  an 
agent  in  Medium  condition  will  still  be  in  Medium  condition  after  this  failure 

\IHm(M)  =  mean  time  to  repair  an  agent  for  a  degrading  failure 

Grg         =  fraction  of  service  effort  applied  to  repair  a  restored  Medium  Down  agent  to 
Good 

Q-mg        -  fraction  of  service  effort  applied  to  repair  a  Medium  Down  agent  that  had  a 
fatal  failure  while  it  was  in  Good  condition 

Although  the  above  are  constants  in  the  developments  that  follow,  they  can  be 
replaced  by  nearly  arbitrary  functions  of  time,  or  even  state,  especially  in  the  quasi- 
stochastic  deterministic  model.  The  differential  equations  arising  in  that  formulation  can 
be  numerically  solved,  e.g.  using  MATLAB.  This  paper  is  devoted  to  the  steady-state 
situation,  for  which  analytical  solutions  are  available,  and  which  permit  derivation  of 
(almost)  optimal  control  strategies.  But  transient  and  also  time-dependent  solutions  are 
often  important  and  can  be  obtained  more  easily  with  the  present  approach  than  using 
other  analytical  tools  of  which  we  are  aware. 

Let  S(f)=DGR(t)+DMR(t)+DGB(t)+DMB(.t)+DMG(t),  the  number  of  agents  down  at  time  t. 


Let  H(x)  be  a  differentiable  no n- increasing  function  of  x;  it  will  represent  the  amount 
of  service  effort  when  there  are  x  agents  waiting  for  or  being  served.  See  Filipiak  (1988). 
An  example  is 

H(x)  =  -1—  (2.1) 

\  +  csx 

where  cs  is  a  suitable  constant  (unity  in  what  follows). 
Time-Dependent  Equations 

at  < , < 

Failure  or  Restoration  demand  from  Good  state 

+H{S(t)lflr{G)DGR  (r)  +  /im  (M)DMG  (t)  +  nm  (B)DGB  (*)] 

< „ < 

Service  to  Good  state 

at  < . '  < v < 

Partial  Failure,  Failure  to  Bad  or 

Good  to  Medium      Restoration  demand  from  Medium 


+ 


H{S(t)%fir  (M)(l  -  aRG  )DMR  (t)+fim  (B){1  -aMG  )Dm  (t)] 


Restoration  or  Repair  to  Medium 

dDCR(t) 


dt 


Good  Restoration  Restoration 

demand  completion  to  Good 


Medium  Restoration  completion 

Restoration  demand  to  Medium 


dt 


Medium  fails      Repair  of  Medium,  failed  to  Bad, 
to  Bad  to  Medium 


(2.2a) 


(2.2b) 


=   eGUc{t)  -H(S{t))iir{G)DCR(t)  (2.2c) 


^W=      eMuM(t)      -H{S{t))iir{M)DMR{t)  (2.2d) 

dt 


]=^MBUM(t)-    H(S(t))nm(B)DMS(t)  (2.2e) 


dt  < „ — ; '         » ■ v ' 

Number  continuing  from  beyond  minimum  repair:  Repair  to  Good  completion 

Medium-repaired  to  Good  repair  state 


^f^  =  laBUG(t)  -  H(S(t))nm(B)DGB(t) 

at         < . '    « » 

Total  failure.      Repair  Down  Good  to  Good 
Good  to  Bad 


(2.2g) 


In  Appendix  1  it  is  shown  that  the  solution  to  the  steady-state  equations  obtained  from 
(2.2)  by  setting  derivatives  equal  to  zero  is 


Um=U-\/(1  +  k) 

Ug=U-k/(\  +  k) 

where  U  is  the  modified  solution  of  a  quadratic: 

IN 


U  = 


[l  +  (1  +  csN)c/(l  +  k)]  +  ^[l  +  (1  +  csN)c/(l  +  K)f  -  4csNc/{\  +  k) 

K  =  {aRGeM+aMG^MB)I^GM 


Em             Aiud 
C  = r2—r+ ^r—-\-K 


eG       ,      AGM  AGB 


(2.3) 
(2.4) 

(2.5) 

(2.6) 
(2.7) 


lir{M)    vm(B)      Ur(G)     Hm(M)     /zm(B) 

2.1  Repair  Control  for  the  Pseudo-Stochastic  Model 

Suppose  the  expected  utility  of  the  system  of  agents  is  written  as 

g(a;p,N)  =  UG(ccN)+PUM(a,N) 
where  we  let  ccrg  =  (Xmg  =  a,  the  probability  that  an  agent  that  has  been  Down  and  has 
been  restored/repaired  to  Medium  level  is  allocated  further  repair  to  the  Good  state,  with 
0<P<  1.  This  notation  makes  explicit  the  degradation  of  capability  associated  with 
being  in  the  Medium  rather  than  Good  state,  and  also  the  control  inherent  in  the 
probability  a;  finally,  the  influence  of  the  agent  population  size,  TV,  is  expressed. 

Given  values  for  p  and  N  in  addition  to  other  rate  parameters,  the  utility  function  g 
can  be  numerically  studied/optimized  on  a.  Considerable  numerical  exploration,  using 
random  selections  of  system  parameters  in  a  manner  analogous  to  that  suggested  by 
Miller  (1997),  leads  to  the  empirical  conclusion  that  random  strategies  (0  <  a<  1)  are 


rarely  optimal,  and,  when  they  do  occur  are  only  slightly  better  than  pure  strategies 
(a  =  0,  or  a  =  1).  In  fact,  consideration  of  the  case  TV  large  clarifies  the  situation  and  leads 
to  the  nearly-optimal  control  policy  as  follows: 


Let 


£M       ■     ^MB 

Hr{M)     nm(B) 


.  _      £G       !      ^GM      |      ^GB 


/zr(G)     vm{M)     LLm{B) 

£M+^MB 
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X 


GM 


Then  k=  ya  and  c  =  a  +  bya,  the  parameters  in  the  solution  U. 


To  show  this,  let  N  — >  ~  in  expression  (2.5)  for  U  to  obtain 

\  +  k         l  +  ya 


UH  = 


csc      cs(a  +  bya) 


so,  by  (2.3) -(2.4) 


g(a;p,oo)  = 


'l+X^ 


«      +.     P 


Since 


I,  czc  JI(\  +  k:)     (1  +  k) 
cs(bya  +  a)' 


dg  =  y(a-bp) 
da     (bya  +  a)2 


(2.8) 

(2.9) 

(2.10) 


When  N  becomes  large, 

Optimum  a  =  1 

ifp<a/b; 

Optimum  a  =  0 

]fp>a/b. 

(2.11) 


the  above  policy  is  verified. 


3.  A  Stochastic  Model 

Consider  a  closed  queuing  network  with  N  agents  (e.g.  mobile  sensors).  There  are  two 
service  classes:  up  (U)  and  down  (D).  An  agent  chooses  a  type  each  time  it  leaves  the 
down  service  class  in  good  condition.  The  agent  types  are 

G:    is  in  good  condition 

M:    is  in  medium  condition 
The  expected  time  an  agent  of  type  i  spends  in  the  U  class  is 

-i--  '  •  (3-D 

VG       £G  +  AGM  +  AGB 

Let  cig{U)  be  the  expected  amount  of  time  an  agent  spends  up  in  good  condition  before  it 
is  reclassified;  let  <im(U)  be  the  conditional  expected  amount  of  time  an  agent  spends  up 
in  medium  condition  before  it  is  reclassified,  given  it  spends  time  in  Medium  condition; 
let  a(JJ)  be  the  total  expected  time  an  agent  spends  in  the  up  state  before  it  is  reclassified. 
For  0<ccrg+ccmg 

*M  (U)  =  — i — r (3.2) 

£M+AMB  £M+AMB 

°g(U)=  1-  (3.3) 

£G+AGB+AGM 

a(U)  =  aG(U)+      J:GM^. a„(U).  (3.4) 

£G+A-GB+AGM 

Let  og(D)  be  the  expected  amount  of  time  an  agent  spends  down  with  a  MAF  but  is  in 
otherwise  good  condition  before  it  is  reclassified;  let  (2m(D)  be  the  conditional  expected 
amount  of  time  an  agent  spends  down  in  Medium  condition  before  it  is  reclassified,  given 
it  spends  time  in  Medium  condition;  let  Omr(D)  be  the  conditional  expected  amount  of 
time  a  Medium  condition  an  agent  spends  in  restoration  before  being  reclassified,  given  it 
spends  time  in  Medium  condition;  let  <2mm(D)  be  the  conditional  expected  amount  of  time 
an  agent  in  Medium  condition  spends  being  repaired  for  MAF  before  being  reclassified, 


given  it  spends  time  in  Medium  condition;  let  a(D)  be  the  expected  amount  of  time  an 
agent  spends  in  Down  state  before  it  is  reclassified.  For  0<ocrg+clmg 

£M 1         !         ^MB L_ 

a     fD\=£M+XMB  Er(M)      £M+*>MB  VmW    ,  *  (3  5) 

£M+A-MB  £M+AMB 

ac{D)  = £g L_+ isB L_  (3.6) 

£G+^GB+^GM  Vr(G)      £G+*GB  +  ^GM  Hm(G) 

a(D)  =  aG(D)+  ]GM  aM(D)  (3.7) 

£G+AGfl+AGAf 
£M  1 


*»(*)■       ;     ^+A^^(M) (3.8) 

£M  „         ,         AMB        „ 

: aRG  + —, aMG 

£M  +  AMB  £M  +/-MB 

^MB I 

„       rn\_ £M+^MB  VjJM) a  on 

aMB\u)- ; 5 \>V) 

£M         „        i        AMB        „ 

: aRG  + -Z aMG 

£M+AMB  £M+A-MB 

Theorem  (3.12)  of  Kelly  (1979)  implies  that  the  limiting  distribution  of  the  number  of 
agents  in  the  up  class  and  the  down  class  is 

nUp{nu,nD)  =  K — — (3.10) 

Jmin(£,.y) 
fc=l 

where  AT  is  a  normalizing  constant  and  s  is  the  number  of  servers  in  the  D  class.  The 
expected  number  of  agents  in  the  up  class  (respectively  down  class)  is 


ElU]  =  Ku^nu^-  (3.11) 


Zo       nu[ 


N            a(D)nD 
(respectively  E[D]  =  KDJ^nD  -^-^ )  (3.12) 


"0=°     I|min(*fj) 


where  Ku  and  Kd  are  normalizing  constants.  The  expected  number  of  agents  in  the  up 
class  that  are  in  good  condition  (respectively  medium  condition)  is 


(respectively,  E[UM]  =  £[tf]^M) 


(3.13) 


(3.14) 


The  expected  number  of  agents  in  the  down  class  that  are  being  repaired  for  an  MAF  but 
are  otherwise  in  good  condition  (respectively  are  in  medium  condition) 


(respectively,  E[DM]  =  E[D]^^-) 


(3.15) 
(3.16) 


Numerical  Examples 

Below  are  tables  comparing  the  numbers  of  agents  in  various  categories  for  the 
deterministic  and  stochastic  models.  While  the  two  models  are  not  exactly  comparable, 
the  deterministic  model  yields  results  close  to  those  of  the  stochastic  model. 

Table  1 

N=4;  ;W=0.1;  Ags=0.05;  AM5=0.05;  £g=0.2;  Sm=0.2;  jim(M)=0.5;  /im(G)=0.5;  fim{MG)=5- 
Hr(G)=10;  /ir(M)=10;  a/?G=0.5;  aWG=0.5;  single  server;  cs=l 

Expected  Number 


Category 

Deterministic 

Queuing 

Model 

Model 

Good:  Up 

1.81 

1.87 

Medium:  Up 

1.45 

1.50 

Good:  Catastrophic  Failure 

0.32 

0.27 

Medium:  Catastrophic  Failure 

0.25 

0.21 

Repair:  Medium  to  Good 

0.06 

0.05 

Good:  Restore 

0.06 

0.05 

Medium:  Restore 

0.05 

0.04 
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Table  2 

N=4;  Acu=U  ^fi=0.05;  XMB=0A;  fifc=0.2;  8^=0.5;  ^im(M)=0.5;  /im(G)=0.5;  /z„(MG)=5; 
fj.r(G)=\0;  fir(M)=7;  aRG=0.5;  aWG=0.5;  single  server;  cs=l 

Expected  Number 


Category 

Deterministic 

Queuing 

Model 

Model 

Good:  Up 

0.52 

0.60 

Medium:  Up 

1.73 

2.00 

Good:  Catastrophic  Failure 

0.14 

0.11 

Medium:  Catastrophic  Failure 

0.95 

0.76 

Repair:  Medium  to  Good 

0.29 

0.23 

Good:  Restore 

0.03 

0.02 

Medium:  Restore 

0.34 

0.27 

4.  The  Repair  Policy  for  the  Stochastic  Model  with  iV=l 

Let 

1  AC„  1  1 


E[U(a)]  = 


E[D(a)]  = 


AgB+Zg+A-cm        "~cb  +£g  +  Agm  CC  A  MB  +^M 


A, 


1 


•+■ 


1 


Acs  +£c  +  XCM  ^m{B)     Acs  +£c  +&CM  flr{G) 
A 


■M 


A*  MB 


1 


Amb  +£m  Mr(M)     XMB  +£m  /J-m(B) 

1       1 


t      m  _  Ags  +  £c  +  "-cm         Xcb  +  £g  +  Xqm  &  Xmb  +  £m 


E[U(a)  +  D(a)] 
a  +  p 


A  CM 


A  cm  +£m 


a 


1  4  GB  £°  CM 


fim{B)     flr(G)     pLm(M) 


1 


+■ 


-CM 


A  MB  +£ 


MaTtw 


£a*  Am 


Hr(M)       ^Lm{B) 


cc  +  P- 
7 


a[l  +  b]  +—a 
7 


(4.1) 


(4.2) 


(4.3) 


Note  that 


dg(a;p)  _  ° 

l+b) 

Q      P 
Mb      . 

1 
7 

da 

f 
a[l 

+  b]+—a 

7   J 

2 

(4.4) 


Hence  the  repair  policy  is  as  follows. 

The  Repair  Policy  for  Stochastic  Model  with  N=l: 


If  p< 


a 


l+b 


then  the  maximizing  a  is  a=l;  always  repair  the  agent  in  Medium 


condition  to  Good. 


If  p> 


a 


l  +  b 
condition  to  Good. 


then  the  maximizing  a  is  cr=0;  never  repair  the  agent  in  Medium 
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APPENDIX  1 
Long-Run  Solutions 

Setting  the  derivatives  equal  to  zero  in  system  (2a)  -  (2g)  results  in  the  following 
equations 

+H(Sinr{G)DGR  +^im(M)DMG  +^im(B)DGB] 

0  =  ^GmUg  "  (£M  +  &  MB  Wm 

+H(S)[vr(M)(\-aRG)DMR+iim(B){l-ccMG)DMB] 


(Al-la) 


(Al-lb) 


0  =  eGUG  -  H(S)vr(G)DGR  (Al-lc) 

0  =  eMUM  -  H(S)fir(M)DMR  (Al-ld) 

0  =  ^mbUm  -H(S)vm(B)DMB  (Al-le) 

0  =  H(S)[iir(M)aRGDm  +iim(B)ccMGDMB]-H(S)lim(M)DMG  (Al-lf) 

0  =  XGBUG-H(S)iim(B)DGB  (Al-lg) 

These  must  be  solved  subject  to  the  condition  that  all  state  values  sum  to  N.  Equations 
(Al-ld),  (Al-le),  and  (Al-lg)  result  in 
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Substitution  of  (Al-3)  and  (Al-2)  into  equation  (Al-lb)  results  in 

+[(X-aRG)eMUM  +{l-ccMG)XMBUM] 


(Al-5) 


Thus 


UG=WM  (Al-6) 

where 

jc  =  aRG€M  +ccmg^mb 

^gm  (Al-7) 

ifAcM>0. 

Substitution  of  (Al-3)  and  (Al-2)  into  equation  (Al-lf)  results  in 

0  =  ZmUrgUm  +*-mb<*mgUm  ~H{S)iLm(M)DMG  (Al-8f) 

Multiplying  equation  (Al-ld)  by /ir(G)//zr(M),  equation  (Al-le)  by  jir(G)/flm(B),  equation 
(Al-8f)  by  fir(G)/jim(M)  and  equation  (Al-lg)  by  fir(G)/nm(B),  adding  the  resulting 
equations  and  using  (Al-6)  results  in 

cUM  =  H(S)S  (Al-9) 

where 

c=  £°K    i     £m     i    ^m    i   ^gmK  i  ^gbK  (Al  10) 

fir(G)     fir(M)     fim(B)     nM(M)    nm{B) 

Note  that 

S  =  N-(1  +  k)Um  (AMI) 

Thus  (Al-9)  can  be  rewritten  as 

cUM  =[N-(1  +  k)Um]H{N-(1  +  k)Um)  (Al-12) 

Putting  U=Ug+Um=(1+k)Um  and  substituting  into  equation  (Al-12)  results  in 
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l  +  K 


U  =  [N-U]H(N-U) 


Rewriting, 


c        U 


=  H{N-U) 


1  +  k[N-U] 
Equation  (Al-14)  has  one  solution  between  0  and  N. 

In  the  special  case  H(x)=l/(l+CsX)  equation  (Al-14)  is  a  quadratic 


(Al-13) 


(Al-14) 


0  =  -^-U2  - (1  +  -^-(1  +  csN))U  +  N 

l  +  K  l  +  K 


(Al-15) 


Finally 


and 


U  = 


a+—(i+csN))-. 


l  +  K  l  +  K 


CX 

2s 


l  +  K 


U^U/d  +  K) 


UG=- U 

l  +  K 


(Al-16) 
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APPENDIX  2 
A  Repair  Policy  for  the  Deterministic  Expected-Value  Model 

Let  aRG-ocMG-cc.  Put 

a  =  _£jL_      *^L_  (A2.1} 

b  =  _J^_    J^L_    J^_  (A2.2) 

/zr(G)     ^im(M)     /*„(*) 

7  =  ££  +  AmL  (A23) 

Note  that  K=ya  and  c=a+&ya.  Thus, 

_£_=a±bycL  =  a+I{b-a)cL  (A2_4) 

1  +  k:      l+>«  l  +  ya 

Let  f/(a)  be  the  solution  to  equation  (Al-9). 

Consider  the  weighted  (expected)  number  of  agents  up 

g(a;l3)  =  Ua(a)  +  pUM(a) 

l+ya 
for  0  <  p  <  1 . 

Policy  I:   This  maximizes  a  utility  function  that  assigns  a  relatively  low  value  to  units  in 
the  Medium  state. 

If  b<a,  then  g{ar,f5)  is  maximized  at  a=l;  always  repair  an  agent  in  Medium  condition 
to  Good. 

If  b>a,  then  there  is  a  0  <  #>  </?i  <  1  such  that  for  /3</3b  g(cr,p)  is  maximized  at  a=\ 
(always  repair  a  Medium  agent  to  Good);  for  (5>pi  g(cc,p)  is  maximized  at  a=Q  (never 
repair  a  Medium  agent  to  Good). 
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Policy  II:  This  maximizes  the  long-run  total  number  of  agents  up 

If  b<a,  then  U(a)  is  maximized  at  a=l;  that  is  always  repair  an  agent  in  the  Medium 
condition  to  Good. 

If  b>a,  then  U(a)  is  maximized  at  cr=0;  that  is  never  repair  an  agent  in  Medium 
condition  to  Good. 
Proof  for  Policy  II: 

Q 

Note  that  f{pc)  = is  a  decreasing  function  of  a  if  b<a  and  is  a  nondecreasing 

l  +  K 

function  of  a  otherwise.  Since  H(x)  is  a  decreasing  function,  H(N-U)  is  an  increasing 
function  of  U.  Further,  (N-U)H(N-U)  is  a  decreasing  function  of  U.  If  b<a  so  that /(a) 
decreases  with  a,  then  equation  (Al-13)  implies  that  U(a)  increases  with  a.  If  b>a,  then 
f(a)  increases  with  a  and  U{a)  decreases  with  a.  Policy  I  follows. 
Proof  for  Policy  I: 
Note  that 

da6K      J      l+ycc     K        l+ya     da 

y    TT/  x      ft    dU(a) 
U{cc)  +  -  ' 


+ 


l  +  ya  l  +  ya    da 

l  +  ya  l  da 


lfb<a,  then  — ^->0  and  — g(a;/?)>0;  thus  the  maximizing  a  for  g(cr,p)  is  05=1. 
da  da 

Ub>a,  then  dU^  <0.  If  /3=0,  then  y((x;0)=Uc(a).  RecaU  that 
da 


Thus, 


UG(a)  =  yaUM{a). 


—UG(a)  =  yUM(a)  +  ya-—UM{a) 
da  da 
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and 


Hence, 


±u(a)=jLUG(a)+jLUu{a) 

da  da  da 

=  -}UM(a)+[ya  +  l]—UM(a). 


d-U{a)-yUM{a) 


— UM(a)  =  4QL <o. 

da    MK  J  ya  +  l 

The  value  of  a  which  minimizes  Um(cc)  is  a=\.  In  addition  — UM(a)< — U(a).  Since 

da  da 

A.U(a)  =  -^-UG(a)+^-UM(a)  it  follows  thB.tO<-f-U(a)~UM(a)  =  -f-UG(a). 
da  da  da  da  da  da 

Thus,  the  maximizing  value  of  a  for  Ug(o)  is  a=l;  always  repair  agents  in  Medium 
condition  to  Good.  Thus, 

Y     rrr  \      I®-    dU(a)    A 


1  +  ya  l  +  ya    da 

Recall  from  Policy  II  that  if  j3=l  then  — g(a;l)<0  and  the  maximizing  a  is  a=0  (never 

da 

repair  a  Medium  agent  to  Good  condition).  Policy  I  follows. 
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